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APPARATUS AND METHOD FOR EXTRACTING ALGORITHMIC INFORMATION 

"FROM A MES SA G E S TR E AM — " — 



Field of the Invention 

The present invention relates to data communication apparatus and methods and, in 
particular, to apparatus and methods for extracting algorithmic information from a stream of 
messages so that a message stream containing algorithmic information may be transmitted more 
5 efficiently. 

Background of the Invention 

Distributed computer systems, in which a client node is typically remote from a server, 
utilize the technique of distributing execution of an application. More specifically, an 
application server provides application execution services, such as application processing or 

10 access to files and other resources, to client nodes instead of the client nodes providing those 

services. Client nodes are generally cheaper than servers, and since one server typically provides 
services to more than one client, overall system cost is reduced. Additionally, client-server 
systems allow decisions regarding the location of certain system resources (such as applications) 
to be made on a situational basis. Unfortunately, the amount of bandwidth required to transmit 

15 graphical user interface elements can easily exceed the bandwidth provided by relatively high 
bandwidth transport mechanisms such as Ethernet. 

The growing collection of networked computers commonly referred to as "the Internet" 
allows a natural and compelling extension of the flexibility and power provided by client-server, 
distributed systems. In this extension, any "node" may act as a client that receives application 
20 output from a remote "server." Unfortunately, the relatively low bandwidth of Internet 
connections exacerbates the bandwidth consumption problems described above and makes 
widespread use of such a system problematic, even with traditional data compression techniques. 
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Summary of the Invention 

The present invention allows a message stream to be decomposed by a transmitting node 
into one or more sub-streams by a transmitting node and regenerated by a receiving node so that 
the total network traffic between the two nodes is less than would be required to transmit the 
5 message stream in the first instance. One of the sub-streams represents algorithmic information, 
that is, some portion of the message stream represents repetitive or recurring strings or data 
values. Another sub-stream represents parameter information, which is data that does not repeat 
or recur throughout the message stream. Traditional compression techniques may be applied to 
the sub-streams to fiirther reduce the amount of bandwidth necessary to communicate them 

10 between nodes. 

In one aspect, the present invention relates to a method for extracting algorithmic 
information from a message having associated arguments. Each argument has an associated 
value. The message is identified as algorithmic information. The first time the value of an 
argument is encountered, it is identified as parameter information. Each subsequent time the 

1 5 value of the argument is encountered it is identified as algorithmic information. 

In another aspect the present invention relates to a method for extracting algorithmic 
information from a message having associated arguments, each argument having an associated 
value. The extracted information is transmitted from a server to a remote client. The method 
includes the step of identifying, at the server, a message as algorithmic information. A message 
20 identifier is stored in an algorithmic information list. At the server a value of an argument 

associated with the message is identified as parameter information the first time the data value is 
encountered. Each subsequent time the data value is encountered it is identified as algorithmic 
information and a value identifier is stored in the algorithmic information list. 

In yet another aspect, the present invention relates to an apparatus for extracting 
25 algorithmic information from a message having associated arguments, each of the associated 
arguments having an associated value. The apparatus includes a transmitter in electrical 
communication with a network connection that transmits algorithmic information over the 
network connection. The apparatus also includes an extractor which separates a message into 
algorithmic information and value information. The algorithmic information is stored in an 
30 algorithmic sub-stream and the value information is stored in a parametric sub-stream. Both sub- 
streams are stored in a memory element. 
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In still another aspect the present invention relates to a system for extracting algorithmic 
information from a message having associated arguments. Each one of the associated arguments 
has an associated value. The extracted information is transmitted from a server to a client over a 
network connection. The system includes a client and a server. The client includes a receiver in 
5 electrical communication with the network connection that receives algorithmic information 
transmitted over the network connection. The server includes a transmitter in electrical 
connection with the network connection that transmits algorithmic information over the 
connection. The server also includes an extractor which separates a message into algorithmic 
information and value information. The algorithmic and value information is stored in a memory 
10 element. 

Brief Description of the Drawings 

The invention is pointed out with particularity in the appended claims. The advantages of 
the invention described above, and further advantages, may be better understood by reference to 
the following description taken in conjunction with the accompanying drawings, in which: 

15 FIG. 1 is a block diagram of a distributed computer system; 

FIG. 2 is a flowchart of one embodiment of the steps taken to extract algorithmic 
information from a message stream; 

FIG, 3 is a flowchart of the steps to be taken in one embodiment of a heuristic; and 

FIG. 4 is a block diagram of an apparatus for extracting algorithmic information from a 
20 message stream. 

Detailed Description of the Invention 

FIG. 1 is a schematic diagram of a distributed computer system incorporating the 
invention. The system includes a server node 10 coupled to a transport system 12 (e.g., serial 
lines, telephone lines, a local area network, a wide area network, or a wireless communication 
25 medium). Although only one server node 1 0 is shown in FIG. 1 , it is understood that more than 
one server node 10 may be provided. The application servers 14 provide application execution 
services to network client nodes 16. In some embodiments each server node 10 provides a single 
application server 14, instead of the multiple application servers 14 depicted in FIG. 1 . 

In some embodiments, the system described in FIG. 1 is a traditional client-server system 
30 operating over a local area network such as Ethernet, which provides a bandwidth up to 
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substantially 1 0 Megabits per second (Mbps). In other embodiments, the transport mechanism, 
such as a serial connection over twisted copper-pair wiring typical in connections between 
Internet nodes, provides low bandwidth. Client nodes 16 may be located remotely from 
application servers 14 and communicate at a rate of 56 Kilobits per second (Kbps). In certain of 
5 these embodiments the client nodes 16 and application servers 14 communicate at a rate of 28.8 
Kbps. In further of these embodiments the client nodes 16 and application servers 14 
communicate at a rate of 9.6 Kbps or 2.4 Kbps. 

When a client node 16 wishes to run an application, the application server 14 intercepts 
the user interface data of the client node 16 (e.g., the display screen, keyboard, and mouse) and 

10 transmits/receives this data to/from a user program running at the client node 16. For 
applications in which the application server 14 intercepts a graphical user interface, the 
application server 14 intercepts and transmits various graphic elements such as lines, arcs, 
ellipses, or bezier curves. In some embodiments the application server 14 communicates 
graphical user interface data to a client node 1 6 using one or more messages. The techniques 

15 described below may be advantageously used with any protocol that results in a message stream 
between nodes, including but not limited to: the X Windows protocol; the Serial Line Interface 
Protocol; the Point To Point protocol; the Independent Computing Architecture (ICA) protocol, 
manufactured by Citrix Systems of Fort Lauderdale, Florida; the PostScript printing and display 
protocol; the QuickDraw protocol, manufactured by Apple Computer of Cupertino, California; or 

20 the Graphic Device Interface (GDI) protocol, manufactured by Microsoft Corporation of 
Redmond, Washington. 

Table 1 below shows a message stream that may be sent from an application server 14 to 
a client node 16 to instruct the client node 16 to draw a rectangular graphic user interface 
element 

Table 1 

draw Jine (0,0,0,100) 
drawjine (0,100,100,100) 
drawjine (100,100,0,100) 
drawjine (0,100,0,0) 

25 In the example described above, the drawjine command instructs a client node 16 to draw a 
straight line from at a starting point to an ending point. The first drawjine command in Table 1 
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instructs a node to draw a line beginning at an x-y coordinate location of (0,0) and ending at an 
x-y coordinate location of (0,100). 

Referring now to FIG. 2, the server 14 begins extraction of algorithmic data by getting 
the next logical element from the message stream (step 202). A logical element is any data in the 
5 message stream that has inherent meaning, such as the drawjine messages, the x coordinate 
location values, and the y-coordinate location values. The next logical element may be stored in 
a convenient memory element from which the server 14 retrieves it. For example, the server 14 
may store messages as they are generated by an application and retrieve them later for 
processing. Alternatively, the server 14 may receive the next logical element and process it in 

10 "real-time." In these embodiments the server 14 may receive multiple logical elements at a time. 
The server 14 may use any number of techniques to identify logical elements. For 
example, the server 14 may be configured with knowledge of the protocol used to generate the 
message stream. Such knowledge would allow the server 14 to easily identify messages and 
arguments associated with those messages. In one embodiment the server 14 maintains a look- 

15 up table containing all messages provided by the protocol. In this embodiment the server 14 
identifies messages by comparing a logical element to the look-up table. Once a message has 
been identified, the server 14 can identify data values based on the parameters expected to 
accompany the message, e.g., two byte-long arguments may follow a particular message. 

Once the server 14 has gotten the next logical element, the server 14 uses a heuristic to 

20 identify algorithmic data based on the type of logical element the server 14 is processing (step 
204). For example, a message may always be determined to be algorithmic information. As 
another example, the most recently encountered y-coordinate values could be compared to 
determine if a simple, commonly occurring relationship between those y-coordinate values 
exists. If such a relationship exists, then the y-coordinate value, is identified as algorithmic 

25 information. In general, the function of the heuristic is to express a type of data value 

algorithmically as some function of the previous occurrences of the data value in the message 
stream. Examples of such relationships include, but are not limited to, that the most recently 
received y-coordinate value: is equal to the last encountered y-coordinate value; is one greater 
than the last received y-coordinate value; or is equal to the last received value plus a small delta. 

30 The algorithmic encoding for the element is placed into an algorithmic sub-stream (step 

206), even if the encoding specifies that no relationship could be identified. The algorithmic 
sub-stream stores the algorithmic data identified by the server 14. In one embodiment the 
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algorithmic sub-stream comprises a stack memory structure. In other embodiments, the 
algorithmic sub-stream is provided as a portion of random access memory. The algorithmic sub- 
stream may also be provided as a doubly-linked list, a singly-linked list, a queue memory 
structure, or an array. 

5 The heuristic should also define the meanings of any algorithmic encodings it places into 

the algorithmic sub-stream. That is, the server 14 and client node 16 must both understand what 
a particular algorithmic encoding represents so that the client node 16 is able to reverse the 
extraction process. Thus, the encodings placed in the algorithmic sub-stream identify the 
formula or algorithm that can be used by the client node 16 to reconstruct the message stream. 

10 Using the message stream of Table 1 as an example, the first three coordinate locations 
encountered by the server 14 have a value of zero. The second and third coordinate value 
locations may be represented in the algorithmic sub-stream by an encoding identifying them as 
having the same value as the first coordinate value. 

If the algorithmic encoding does not fully define the data value of the logical element 

15 (step 208), parameter information is placed in the parameter sub-stream (step 2 1 0). The 

parameter information is the residual information necessary to regenerate the data value. For 
example, in a case where the algorithmic data indicates that no algorithm for expressing the data 
value could be identified, the actual data value must be added to parametric sub-stream. In 
another example, if an algorithmic encoding is placed in the algorithmic sub-stream indicating 

20 that current data value is the same as the immediately previous data value plus a small delta, the 
value of the small delta must be placed in the parametric sub-stream. 

The server 14 determines if there are more logical elements of the message stream to 
process (step 212). For embodiments in which the message stream is stored in a memory 
structure, this may be done by checking to see if the memory is empty or if the end of the 

25 particular memory structure has been reached. For embodiments in which messages are received 
as they are generated, a message may include some information that signals it is the last message. 
If more messages remain to be processed, then the server 14 gets the next logical element in the 
message stream (step 202). If not, then the server 14 is done (step 214). For embodiments in 
which the server 14 receives messages as they are generated the server 14 may, in step 214, wait 

30 to receive new messages using some form of looping or interrupt mechanism. 

Once the server 14 has constructed the algorithmic and parametric sub-streams, those 
sub-streams are transmitted to the client node 16. The client node 16 reconstructs the message 
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stream by using each formula from the algorithmic sub-stream. The client node 16 uses each 
formula to regenerate the values of the logical items in the message stream, consuming data 
values from the parametric sub-stream as directed by the formulae. 

In one embodiment the algorithmic and parametric sub-streams may be further 
5 compressed before transmission to the client node 16. An exemplary compression algorithm that 
could be used to further compress the sub-streams is Lempel-Ziv-77 and its derivatives. In other 
embodiments the server 14 stores the sub-streams it transmits to the client node 16 in a buffer 
and the client node 16 stores the sub-streams received from the server 14 in a buffer. In this 
embodiment, the server 14 compares a sub-stream to the server buffer before transmitting the 

10 sub-stream to the client node 1 6. If the sub-stream matches an entry in the buffer, then the server 
14 has previously transmitted the sub-stream to the client node 16. The server 14 transmits a 
glyph to the client node 16 that indicates the starting point in the buffer and length of the match 
instead of the sub-stream itself. An alternative compression technique which may be used is 
described in United States Patent Application Serial No. 09/084,838, filed May 26, 1998, the 

1 5 contents of which are incorporated herein by reference. 

Referring now to FIG. 3, a particular heuristic for separating algorithmic data and 
parametric data will be discussed. The particular heuristic depicted by FIG. 3 is particularly 
suited for algorithmic data extracted from a message stream composed of drawing commands, 
such as the message stream shown in Table 1. In this embodiment, the server 14 gets the next 

20 logical element in the message stream (Step 202, FIG. 2) and determines if the logical element is 
a message (step 302). The server 14 can determine if the logical element is a message by 
comparing the element to a look-up table containing a representation of all messages provided by 
the protocol. Alternatively, messages may be indicated by a bit or flag embedded in the message 
stream. If the server 14 determines that the logical element is a message, the server inserts an 

25 algorithmic encoding identifying the message into the algorithmic sub-stream (step 308). 

If the server 14 determines that the logical element is not a message, the element is a data 
value. The server 14 attempts to determine if this is the first time the data value has been 
encountered (step 304). If not, the data value can be represented as algorithmic data and an entry 
is placed into the algorithmic sub-stream (step 308) indicating that the current data value has 

30 been previously received. If, however, the current data value has never been received, then the 
server 14 places an algorithmic encoding into the algorithmic data stream indicating that a new 
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data value has been encountered (step 3 10) and the data value is placed into the parametric sub- 
stream (step 312). 

Referring now to FIG. 4 an apparatus 40 for extracting algorithmic information from a 
message stream includes a transmitter 42, an extractor 44, a memory element 46 in electrical 
5 communication with the extractor 44 and the transmitter 42, and an optional compressor 48 
(shown in phantom view). The extractor 44 operates on one or more messages to separate 
algorithmic data from parametric data. Extractor 44 may be in electrical communication with a 
memory element storing the messages (not shown). In other embodiments, the extractor 44 is in 
direct electrical communication with the source of the messages. Extractor 44 is in electrical 

1 0 communication with a memory element 46. The extractor 44 stores algorithmic sub-streams and 
parametric sub-streams in the memory element 46 for eventual transmission to a client node 16. 
Memory element 46 may be a structured memory element such as a stack or queue. 
Alternatively, memory element 46 may be provided as random access memory. If the memory 
element 46 is random access memory, it may be configured to provide a structured memory 

1 5 element for storing the sub-streams produced by the extractor 44. A transmitter 42 is in electrical 
communication with the memory element 46. The transmitter is also in electrical 
communication with a network connection (not shown) which allows it to transmit the 
algorithmic and parametric sub-streams produced by the extractor 44. The transmitter 42 drives 
the sub-streams over the network connection to a client node 16. The transmitter 42 may be one 

20 or more transceivers embodied as integrated circuits which connect to the network connection 
via a port. Alternatively, the transmitter 42 may be a stand-alone device such as a modem. 

In some embodiments, the apparatus 40 includes a compressor 48 in electrical 
communication with the memory element 46 and the transmitter 42. The compressor 48 
compresses the sub-streams stored in the memory element 46 before they are transmitted to a 

25 client node 16 by the transmitter 42. The compressor 48 may use any form of data compression 
such as Lempel-Ziv-77 and its derivatives. 

The apparatus depicted in FIG. 4 may also be used to reconstruct the message stream. In 
this embodiment, the transmitter 42 is a transceiver capable of receiving sub-streams driven over 
the network connection. The transceiver 42 receives the sub-streams and stores them in the 

30 memory element 46. For embodiments in which compression is used, the transmitter 42 
provides the received sub-streams to the compressor 48 which decompresses the compressed 
sub-streams and stores them in the memory element 46. Extractor 44 then reconstructs the 
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message stream using the algorithmic sub-stream and the parametric sub-stream stored in the 
memory element 46. Thus, a system may be provided in which servers 14 reduce message 
streams to one or more sub-streams and transmit those sub-streams over a network connection to 
a client node 16. The client node 16 receives the transmitted sub-streams and reconstructs the 

5 original message stream. 

In some embodiments, the functionality described above may be implemented as 
software executing on a general purpose computer. For example, such a program may set aside 
portions of the computer's random access memory to provide the algorithmic and parametric 
sub-streams. Program logic may be used to effect the determinations described above. In such 

10 an embodiment, the program may be written in any one of a number of high level languages such 
as FORTRAN, PASCAL, C, C++, or BASIC. Additionally, the software could be implemented 
in an assembly language directed to the microprocessor resident on the target computer, for 
example, the software could be implemented in Intel 80x86 assembly language if it were 
configured to run on an IBM PC or PC clone. The software may be embodied on an article of 

15 manufacture including, but not limited to, a floppy disk, a hard disk, an optical disk, a magnetic 
tape, a PROM, an EPROM, EEPROM, field-programmable gate array, or CD-ROM. 

Having described certain embodiments of the invention, it will now become apparent to 
one of ordinary skill in the art that other embodiments incorporating the concepts of the 
invention may be used. Therefore, the invention should not be limited to certain embodiments, 
20 but rather should be limited only by the spirit and scope of the following claims. 
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CLAIMS 

What is claimed is: 

1 1 . A method for extracting algorithmic information from a message stream, each message 

2 having associated arguments and each argument having an associated value, the method 

3 comprising the steps of: 

4 (a) identifying a message as algorithmic information; 

5 (b) identifying the value of an argument as parameter information the first time the 

6 value is encountered; and 

7 (c) identifying the value of the argument as algorithmic information each subsequent 

8 time the value is encountered* 

1 2. The method of claim 1 wherein step (b) further comprises the steps of: 

2 (b-a) identifying the value of an argument as parameter information the first time the 

3 value is encountered; and 

4 (b-b) storing the identified value in an associated memory element 

1 3. The method of claim 2 wherein step (b-b) comprises storing the identified argument in a 

2 stack memory element 

1 4, The method of claim 1 further comprising the steps of storing a message identifier in an 

2 algorithmic sub-stream when a message is encountered and storing an argument identifier in the 

3 algorithmic sub-stream when a value of an argument is encountered subsequent to the first time. 

1 5. Hie method of claim 2 further comprising the steps of storing a message identifier in an 

2 algorithmic sub-stream when a message is encountered and storing a value identifier in the 

3 algorithmic sub-stream when a value of an argument is encountered subsequent to the first time, 

4 the value identifier comprising the location of the value in the associated memory element. 

16. A method for extracting algorithmic information from a message stream, each message 

2 having associated arguments and each argument having an associated value, and transmitting the 

3 extracted information from a server to a remote client, the method comprising the steps of: 

4 (a) identifying, at the server, a message as algorithmic information; 

5 (b) storing a message identifier in an algorithmic sub-stream; 

6 (c) identifying, at the server, a value of an argument associated with the message as 
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7 parameter information the first time the value is encountered; and 

8 (d) identifying, at the server, the value as algorithmic information each subsequent 

9 time the value is encountered. 

1 7. The method of claim 6 wherein step (c) comprises: 

2 (c-a) identifying, at the server, a value of an argument associated with the message as 

3 parameter information the first time the value is encountered; and 

4 (c-b) storing a parameter identifier in a parametric sub-stream. 

1 8. The method of claim 7 further comprising the step of compressing the parametric sub- 

2 stream. 

1 9, The method of claim 6 wherein step (d) further comprises: 

2 (d-a) identifying, at the server, the value as algorithmic information each subsequent 

3 time the value is encountered; and 

4 (d-b) storing an algorithmic identifier in the algorithmic sub-stream. 

1 1 0. The method of claim 9 further comprising the step of compressing the algorithmic sub- 

2 stream. 

1 11. The method of claim 6 further comprising the step of transmitting the algorithmic sub- 

2 stream, 

1 12. The method of claim 7 further comprising the step of transmitting the parametric sub- 

2 stream. 

1 13. An apparatus for extracting algorithmic information from a message stream, each 

2 message having associated arguments and each argument having an associated value, and 

3 transmitting the extracted information via a network connection, the apparatus comprising: 

4 a transmitter in electrical communication with a network connection; 

5 a memory element in electrical communication with said transmitter, said memory 

6 element providing storage for an algorithmic sub-stream and a parametric sub-stream; 

7 an extractor in electrical communication with said memory element, said extractor 

8 separating a message having associated arguments into algorithmic information and value 
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9 information and storing the algorithmic information in an algorithmic sub-stream; 
1 0 wherein said transmitter transmits the algorithmic sub-stream. 

1 14. The apparatus of claim 13 wherein said extractor stores the value information in a 

2 parametric sub-stream. 

1 15. The apparatus of claim 1 3 wherein said transmitter transmits the parametric sub-stream. 

1 1 6. The apparatus of claim 1 3 wherein said memory element comprises a stack data structure, 

1 17. The apparatus of claim 13 further comprising a compressor in electrical communication 

2 with said memory element and said transmitter, said compressor compressing the algorithmic 

3 sub-stream. 

1 18. A system for extracting algorithmic information from a message stream, each message 

2 having associated arguments and each argument having an associated value, and transmitting the 

3 extracted information from a server to a client via a connection, the system comprising: 

4 a client including: 

5 a receiver in electrical communication with the connection, the receiver receiving 

6 algorithmic information transmitted over the connection; and 

7 a server including: 

8 a transmitter in electrical communication with the connection, the transmitter 

9 transmitting algorithmic information over the connection; 

10 an extractor separating a message having associated arguments into algorithmic 

1 1 information and value information; and 

12 a memory element in electrical communication with said extractor, said memory 

13 element storing an algorithmic sub-stream including algorithmic information separated by said 

14 extractor. 

1 19. The system of claim 1 8 wherein said client further includes a client memory element in 

2 electrical communication with said receiver, said client memory element storing algorithmic and 

3 parametric sub-streams transmitted by said server. 



WO 00/10305 4 ^ > PCT/US99/17611 

-13- 

1 20. The system of claim 1 9 wherein said client further includes an extractor in electrical 

2 communication with said client memory element, said client extractor producing the message 

3 from the algorithmic and parametric sub-streams. 
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